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Abstract 

We study (i-variate approximation problems in the average case setting with respect 
to a zero- mean Gaussian measure v&. Our interest is focused on measures having a 
structure of non- homogeneous linear tensor product, where covariance kernel of v& is a 
product of univariate kernels, 

d 

K d {s,t) = l\n k {s k ,t k ) for s,t e[0,l] d . 

k=l 

We consider the normalized average error of algorithms that use finitely many eval- 
uations of arbitrary linear functionals. The information complexity is defined as the 
minimal number n avg (e, d) of such evaluations for error in the (i-variate case to be at 
most e. The growth of n avg (e, d) as a function of e _1 and d depends on the eigenvalues 
of the covariance operator of and determines whether a problem is tractable or not. 
Four types of tractability are studied and for each of them we find the necessary and 
sufficient conditions in terms of the eigenvalues of the integral operator with kernel !Z k ■ 
We illustrate our results by considering approximation problems related to the prod- 
uct of Korobov kernels lZ k . Each lZ k is characterized by a weight g k and a smooth- 
ness r k . We assume that weights are non-increasing and smoothness parameters are 
non-decreasing. Furthermore they may be related, for instance g k = g(r k ) for some non- 
increasing function g. In particular, we show that approximation problem is strongly 
polynomially tractable, i.e., n wg (e,d) < C e~~ p for all d € N, e G (0, 1], where C and p 
are independent of e and d, iff 

lnf 
liminf - 9k > 1. 

k^oo In k 

For other types of tractability we also show necessary and sufficient conditions in terms 
of the sequences g k and r&. 
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1 Introduction 



Multivariate problems occur in many applications. They are defined on classes of functions 
of d variables. Often the number of variables d is large. Examples include problems in 
computational finance, statistics and physics. These problems have been studied for different 
error criteria and in different settings including the worst and average case settings. The cost 
of an algorithm solving a problem depends on the accuracy e and the number of variables d. 
A problem is intractable if the cost of any algorithm is an exponential function of e^ 1 
or d. Otherwise, the problem is tractable. Different types of tractable problems have been 
considered in the literature. In fact, tractability of multivariate problems has been recently 
a very active research area, see [HI QUI EEE] and the references therein. 

More precisely, the information complexity n(e, d) of a problem is the minimal number 
of information operations needed by an algorithm to solve the problem with accuracy e. 
The allowed information operations consist of function evaluations, or, more generally, of 
evaluations of arbitrary continuous linear functionals. We have 

• weak tractability if n(e, d) is not exponential in d and e" 1 , 

• quasi-polynomial tractability if n(e, d) is of order exp( t (1 + In d)(l + In 

• polynomial tractability if n(e,d) is of order d q e~ p , 

• strong polynomial tractability if n(e, d) is of order e~ p . 

The bounds above hold for all d and all e G (0, 1) with the parameters t,q,p and the pre- 
factors independent of d and e~ l . 

Strong polynomial tractability is the most challenging property. Then the information 
complexity is bounded independently of d. One may think that this property may hold only 
for trivial problems. Luckily, as we shall see, the opposite is sometimes true. 

On the other hand, many multivariate problems are intractable. In particular, they 
suffer from the curse of dimensionality. One way to vanquish the curse is to shrink the class 
of functions by introducing the weights that monitor the influence of successive variables 
and groups of variables. For sufficiently fast decaying weights not only we vanquish the 
curse but obtain strong polynomial tractability; a survey of such results may be found again 
in dm EE]. 

The other way to vanquish the curse is by increasing the smoothness of functions with 
respect to the successive variables. This approach was taken recently in [H] for the worst 
case multivariate approximation in Korobov spaces. In this paper we extend the approach 
of [H] to the average case setting and, in a much broader context, to tensor product Gaussian 
random fields. In this case we denote n(e, d) = n avg (e, d) and restrict ourselves to information 
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operations given by arbitrary continuous linear functionals since the use of function values 
leads to the same results due to [3] and Chapter 24 of [TT] . 

More precisely, we consider non- homogeneous linear multivariate tensor product problems 
in the average case with the normalized error criterion. The normalized error is used to 
measure the error of an algorithm relative to the error of the zero algorithm. A precise 
problem statement is given in Section |5J The study of non- homogeneous case is necessary 
since homogeneous linear multivariate tensor product problems are intractable with this 
error criterion; see Chapter 6 in [9]. 

In Section [3] we recall spectral conditions for different types of tractability in the average 
case and prove some new conditions. The conditions are given in terms of the eigenvalues of 
the covariance operator of the corresponding Gaussian measure. 

In Section H] these conditions are applied to non-homogeneous tensor product approxima- 
tion problems. We equip the space of continuous real functions defined on the d-dimensional 
unit cube [0, l] d with a zero- mean Gaussian measure with a covariance kernel of the form 

d 

K d {s,t) = Y[n k {s k ,t k ), s,t e[0,l} d . 

k=l 

Then n avg (e,<i) depends on spectral properties of the univariate integral operators with 
kernels lZ k - The main results of the paper , Theorems E] - El present spectral conditions for 
polynomial, quasi-polynomial and weak tractability in this tensor product setting. 
In Section [5] we illustrate these results for Korobov kernels, 

oo 

TZ k (x,y) := 1 + 2 g k ^.T 2rfe cos(2tt j(x - y)), x,y e [0, 1], 

3=1 

with varying smoothness parameters r k such that 

| < n < r 2 < • ■ - , 

and weight parameters g k such that 

1 > 9i > 92 > ■ ■ ■ > 0. 
The sequences {r k } and {gk} may be related. We may have 

9k = g(r k ) 

for some non-increasing function g : [|, oo) — > [0, 1]. The popular choice for Korobov space 
is to take g(r) = (2n)~ 2r . 
It turns out that: 
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Weak tractability holds iff 



lim g k = 0. 

k— >oo 



Quasi-polynomial tractability holds iff 

SU P 7T~i — y^9k max ( 1, In — J < oo, 

deN max(l,lnd) ^ \ 9kJ 

under the assumption that liminffc-^oo r^j In k > 0. 

Polynomial tractability is equivalent to strong polynomial tractability. 

Strong polynomial tractability holds iff 

p Q := liminf - f > f. 

k^oo In k 

If this holds then n avg (e, d) < Ce~ p and the smallest p is 

2 2 



max 



2ri - 1 



Other applications of our approach to tensor products problems are given in [7J for covariance 
kernels corresponding to Euler and Wiener integrated processes. We summarize the results 
of [7J in Section [6] and compare them to those of the Korobov case that we study here. By 
adjusting the weights g^, the Korobov case behaves either like the Euler or Wiener case. 

2 Problem setting 

In this section we introduce multivariate problems in the average case setting. We define 
the information complexity and the different notions of tractability. More can be found in 
e.g., [9] and p3]. 

Let Fd be a Banach space of <i-variate real functions defined on a Lebesgue measurable 
set D d C R d . The space Fd is equipped with a zero-mean Gaussian measure fid defined on 
Borel sets of F d . We denote by C^ d : F d * — > F d the covariance operator of fid- Let H d be a 
Hilbert space with inner product and norm denoted by (■, -) H and || • \\n d , respectively. 

We want to approximate a continuous linear operator 

Sd '■ Fd — > Hd- 
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Let v d = fid S d be the induced measure. Then v d is a zero-mean Gaussian measure on the 
Borel sets of Hd with covariance operator C Vd : Hd — > Hd given by 

W d — Od Od 

where : Hd —> F*[ is the operator dual to Sd- 

Then C Ud is self-adjoint, nonnegative definite, and has finite trace. Let (\d,j, Vd,j)j=i,2,... 
denote its eigenpairs 

C Ud Vd,j = A dj - r] d j with A dj i > \ d ,2 > • ■ 

Then 

trace(C^) = A rf)i = / \\g\\ 2 Hd u d (dg) = \\S d f\\ 2 Hd fi d (df)<oo. 

j = l J J Fd 

We approximate Sdf for / e Fd by algorithms v4 n that use n function evaluations or 
n evaluations of arbitrary continuous linear functionals. It suffices to consider the case of 
arbitrary continuous functionals since it is known that the results are roughly the same for 
function values, see [3] and Chapter 24 of [11]. Without essential loss of generality, see e.g., [9] 
as well as [15], we can restrict ourselves in the average case setting to linear algorithms A n 
of the form 

n 

Mf) = L M) 9j with Lj e F d *, gj e H d . 
The average case error of A n is defined as 

e^(A n )=(J^ \\S d f-Mf)\\ 2 Hd ^(df) 

For a given n, it is well known that the algorithm A n that minimizes the average case 
error is of the form 

n 

A n(f) = ( Sd f> ^h) Hd Vd,k, (1) 

k=l 

and its average case error is 

/ 00 \ 1/2 

e avg (^n)= ( Yl ■ ( 2 ) 

For n = we have the zero algorithm A = 0. Its average case error is called the initial error, 
and is given by the square-root of the trace of the operator C Ud , i.e., by with n — 0. 
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The average case information complexity n avg (£, d) is defined as the minimal n for which 
there is an algorithm whose average case error reduces the initial error by a factor e, 



s OO OO 

n^(e, d) = min j n ^ X dJ < e 2 ^ A<y I. 

^ j=n+l j=l > 



(3) 



We present the definitions of four types of tractability that will be studied in this paper. 
Let S = {Sd}d=i,2 ... denote a sequence of multivariate problems. We say that 



S is weakly tractable iff 



In max(l,n avg (e,(i)) 
lim ^ , = 0. 

e-i+d-^oo e 1 + a 



S is quasi-polynomially tractable iff there are positive numbers C and t such that 



n 



avg 



'e,d) < C exp (t(l + ln d) (1 + In e^ 1 ) ) for all d=l,2,..., £6(0,1). 



The infimum of t satisfying the bound above is called the exponent of quasi-polynomial 
tractability and is denoted by t^P 01- ^. 

• S is polynomially tractable iff there are non-negative numbers C, q and p such that 

rf^{e,d)<Cd q e- p for all d=l,2,..., £6(0,1). 

• APP is strongly polynomially tractable iff there are positive numbers C and p such that 

n™ s {e,d) <Ce~ p for all (2=1,2,..., £6(0,1). 

The infimum of p satisfying the last bound is called the exponent of strong polynomial 
tractability and is denoted by p str " av s. 

Tractability can be fully characterized in terms of the eigenvalues X^j- Necessary and 
sufficient conditions on weak, quasi-polynomial, polynomial and strong polynomial tractabil- 
ity can be found in Chapter 6 of [9] and Chapter 24 of [H] . In particular, S is polynomially 
tractable iff there exist q > and r 6 (0, 1) such that 



C := sup v oo 7 d q < oo. (4) 



den 
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If so then 



n avg (e,d) < Ci-t di-r £ i-r 



(5) 



for all d G N and e G (0, 1). 

Furthermore, S is strongly polynomially tractable iff holds with q = 0. The exponent 
of strong polynomial tractability is 



P' 



, str— av 



g = inf 



2r 
1 - r 



r satisfies (jl]) with g = > . 



(6) 



3 General Bounds 

We show bounds on n avg (e, d) which we will use to derive necessary and sufficient conditions 
for the four types of tractability We first analyze an arbitrary problem {Sd} and then restrict 
our attention to non-homogeneous tensor product problems. 

We begin with a bound on n avg (e,d) which from a probabilistic point of view is an 
application of Chebyshev's inequality. 

Lemma 1 For any e G (0, 1), d G N, r G (0, 1) and z > we have 

z/(1-t) 



n avg (e,d) < 
Proof. Let b := [(^ A,,,) e 2 / . A^) 



E^A 



-2*/(1-t) 



l/(l-r) 



. Then 



E E ^/- r <E A ^ T = E A ^^ 

j-^d,j<b j-^d,j<b j j 



Hence, 



n 



avg 



iM) < #{J : A dj > 6} = #{j : \h>b z }< 



E 



< 



E 7 a 



i d,j 



Ei 



6 Z 



E,- Adj 



Ej A5j 



E 7 - Ad,i 



j: A,, ■& Arfj 

*/(l-T) 



-2*/(1-t) 



(7) 



as claimed. 



□ 
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Note that fl7|) immediately proves sufficiency of polynomial tractability conditions in fll]). 
Furthermore, if we set z = r then we obtain the estimate fl^D with the exponent of strong 
polynomial tractability at most 2r/(l — r) for r satisfying (j4]) with q — 0. 

As we shall see now, the bound ([7]) is also useful when we consider quasi-polynomial 
tractability. In the rest of the paper we denote 

ln + d := max(l, hid). 

Theorem 2 S is quasi-polynomially tractable iff there exists 5 G (0, 1) such that 



sup 



< oo. 



Proof. Sufficiency. Apply ([7j) with r = 1 — 



n avs (e,d) < 



In \ 



ln_|_ d 
ln+ d/<5 



G (0, 1) and 2! = 1. We obtain 



exp 



InAfr , 2 _j 

— - — m + d + - m + a In e 



where M$ is the supremum in (jSJ). We can rewrite the last estimate as 

n avg (e-, d) < exp (t(l + In d) (1 + In e' 1 )) 

for t = max(2, In Ms). This means that S is quasi-polynomially tractable. 
Necessity. Assume now that S is quasi-polynomially tractable, i.e., 

n avg {e,d) < C exp (t(lnd + l)(ln e' 1 + 1)) . 

We show that there is 5 G (0, 1) such that 



sup 

den 



E\ ln + ' 
3 \j 



< OO. 



E 7 a 



d,j 
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Note that the last condition is invariant under multiplying the eigenvalues by a positive 
number, and so is the value of n avg (e,d). That is why we may assume that \d,j = 1- 
Quasi-polynomial tractability means that for all e > and d>lwe have 

E Xd >i ^ £2 - 

j>C exp(t(lnd+l)(| lne|+l))+l 

Let e := e (n/C) t ^^+ 1 K Then 

E X d,J < e 2 (n/C)*™ := e 2 (n/Cy h (9) 

j>n 

with h = 2/(*(l + ln d). 

To avoid too small eigenvalues, we introduce a regularization 

X dJ := max{\ dJ , hj* 1 ^}. 

Note that (jUJ) implies 

E^- ^ E A ^ +Y, h i~ 1 ~ h ^ ^ 2 ° h + 1 ) n ~*- ( 10 ) 

j>n j>n j>n 

Let 

N m = {j e N : 2 m/ft < j < 2 {m+1)/h }, m = 0, 1, .... 

Note that the structure of iV m depends on ft,. For any 7 6 (0, 1) and any integer m > we 
have 

E A S 7 ^ E ^S 7 < E A ^ nA ^~ 7 



E [M2 (m+1)//i ) _1 

j>2 m / h 

(by (HUD) < (e 2 C"> + 1) 2- • h'^ 1111 ^^ 
For a fixed 5 e (0, 1), let 7 = We obtain 

E X d7 < ( e2 ° h + !) 2 ~ m • ft _7 2 5(m+1) 



-7 



< (e 2 ^ + 1)2 <5 ■ /,-7 2 -( 1 -' 5 )™ < {e 2 C h + 1)2 5 exp In 



Q — (1— 5) 771 



Since 

sup | lnh\h =: c(t) < oo, 
o<h<l 

it follows that 

oo oo 

E A S 7 = EE A S 7 ^ 2 ^ + ^ E 2 ~ (1 ~ 5)m = : c & *)■ 

j m=0j&N m m=0 



Note that 



Thus we have 



5h 25 
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l + t(l + lnd) + 2 

i 2,5 

EX 1 f(l + lnd) + 2 . 
X dJ ' <oo. 



Let 



Then 



and 
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25\n + d ^ 25 

5 := mm — < < 1. 

den t(l + In d) + 2 ~ t + 2 

9 A A ' 

< 1 - for all d E N, 



t(l + In d) + 2 ~ \n + d 

S' 



E, ln_i_ d 



as required. This completes the proof. □ 

Theorem [2] does not address the exponent £<iP ol_av g of quasi-polynomial tractability. There 
is, however, the bound on the exponent presented in the first part of the proof, 

t qpol-avg < ^-1 max ( 2; In M S ) (11) 

for all 5 G (0, 1) satisfying 

The presence of Ms may seem artificial. However, we now show that in general Ms 
cannot be avoided in determining the exponent of quasi-polynomial tractability. Indeed, for 
5 e (0,1), M > 1 and d > 1 let N = N(d,M,5) := [M Xn+d / 6 \ and consider the following 
eigenvalues 

'\ for j = l,2,...,N, 
for j > N. 
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A 



Then 



6 



M 5 = sup J=1 d > ] — = sup N(d, M, 5) 5/ln+d = lim N(d, M, 5) 5/ln+d = M, 



deN ( ^oo V ln+ d d£N 

Hence quasi-polynomial tractability holds and for any e G (0, 1) we have 

n avs {e,d)= [(l-e 2 )A^l < Cexp (t(l + lnd)(l + In e' 1 )) . 

It follows that 

ln|"(l -e 2 )N(d ,M,S)} InM \nM s 
t > hm hm — = — — = — - — . 

e-s>id->oo In a do 

This justifies the presence of l^Mi j n the bound (jTTI) for exponent of quasi-polynomial 
tractability. However, we believe this bound is not always sharp. 

We now show that the necessary condition on quasi-polynomial tractability can be sim- 
plified by eliminating the powers of 1 — 5/ ln + d. The following lemma will be a convenient 
tool for establishing this fact. 

Lemma 3 Let Ad = X^li -Vi- F° r an V 7 > we have 



3=1 \ 3=1 d J 



12) 



Proof. Jensen's inequality states that for a convex function 0(-) defined on a convex 
set D, non- negative weights p 3 - satisfying YljPj = 1; an d an Y set of arguments Xj from D we 
have 



We apply Jensen's inequality with pj := xj := — In pj and the function 4>{x) = e lx for 
x E D := R. We obtain 

d i 3 3 

- ^X^i x iJ = exp ^ 7 X( _p i ln Pi) J = exp X^i ( ln Ad J ~ ln Ac 
= A ] ex P ^-7 X Pi ln Ad -ij = A ^ exp (^~ 7 Yl 



Ad,j In \d j 
Ad 
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This is equivalent to (I12p and completes the proof. □ 

We will see in the next section that the right-hand side of f fl2|) is convenient for tensor 
product problems. We are ready to simplify the necessary conditions for quasi-polynomial 
tractability. 

Corollary 4 // quasi-polynomial tractability holds then 



SU P / • \ V 

deN m + a ^— ^ Ad \ Adj 



Proof. Quasi-polynomial tractability implies that (jSJ) holds for some 5 £ (0, 1). Let 
7 = 7(d) := i^-j- Using ( Fl2|) we obtain 

ECO \^ ln + d \1~ 7 

3=1 A <*,3 _ : A d,3 



oo \ ln + « J- ±d 



> A 2 exp -7^ —^-t - 



A 

exp I 7 ( In A, - £ ^ * ^ 



3=1 

CO 



3=1 



3=1 

The claim (fl3|) now follows from flH]). □ 

We will use later the following simple inequality that provides a sufficient condition for 

■r- 



the curse of dimensionality. Recall that trace(Cj, d ) = J^yli -Vi denotes the trace of the 



covariance operator. 

Lemma 5 For any d £ N and £>0 we aai>e 

n^e, d) > (1 - e 2 ) tiac < C ^ = (i _ £ 2 ) ( 1 + V ^ V 

In particular, if trace(C^ d ) / A^i > (l + /i) d /or some /i > and a// d £ N, then we have curse 
of dimensionality. 
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Proof. For n = n avg (e, d) we have 

n oo 

trace(C^) - nX dt i < trace(C„J - ^ X d,j = ^ ^ - £ * trace (CVJ- 

j=l j=n+l 



Hence 



n 



[e,d) > (1 -e 2 )trace(C v<J )/Ad,i, 



as claimed. □ 



4 Tensor Products Problems 

In this section we assume that Fd, Gd and Sd are given by tensor products. That is, 
F d = F[ 1] <g> F 2 (1) (8) ... ® and G d = G? } <g> ® • • • ® C# } 

for some Banach spaces of univariate real functions equipped with a zero-mean Gaussian 
measures fi^\ and some Hilbert spaces Here the upper index 1 reminds us that the 

objects are univariate. Furthermore we assume that 

s d = s{ 1] ® sp ® ■ ■ ■ ® 

for continuous linear operators : F^ — > G^ and k — 1,2, ... ,d. 

Let = ^(S^) -1 and let : — > be the covariance operator of the 
measure v*£\ The eigenpairs of are denoted by (X(k,j),r](k,j)) and 

\{k,l) > \{k,2) > •• - > 

as well as Y^=i -M^> i) < 00 • To avoid the trivial case we assume that X(k, 1) > for all 

keN. 

The covariance operator C Ud is now the tensor product 

C Vd = C{ 1] <8> Cf } <8> • • • <8> C< 1} 

and therefore the eigenvalues A^j and the eigenfunctions rjdj are given by corresponding 
products of the one-dimensional eigenvalues and eigenvectors X(k,j) and rjkj, respectively. 
More precisely we have 



{VJieN = \ Y[X(k,j k ) 

• k=1 J jl,32,-jd^ 
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Note that 



d 



oo 



(14) 



jGN k=l j=l 



We want to express necessary and sufficient conditions, for each of the four types of tractabil- 
ity, in terms of the eigenvalues \{k,j), k,j G N. The homogeneous case of the tensor product 
problem, i.e., when F« = if \ Gf = and S« = sf > which implies that 



was studied in [9j Section 6.2] and in a recent paper [12]. In this section we mainly focus on 
a non-homogeneous case. 

4.1 Polynomial Tractability 

We know that S = {Sd} is polynomially and strongly polynomially tractable iff (jlj) holds. 
We now simplify the condition (0J for tensor product problems. 

Theorem 6 Consider a tensor product problem S = {Sd}- Then 

• S is strongly polynomially tractable iff there exists r e (0, 1) such that 



\(k,j) = \(l,j) for all kj = 1,2,... , 




(15) 



If so the exponent of strong polynomial tractability is 




• S is polynomially tractable iff there exists t G (0, 1) such that 




(16) 



A simpler and stronger condition 




(17) 
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is sufficient for polynomial tractability and necessary whenever 



S S I MM) J 



< oo. 



Proof. We prove the four conditions in the iff statements. Let 

^' j):= x[Fiy fora11 fc,JGN ' 

be the sequence of the normalized eigenvalues so that 1 = X(k, 1) > X(k,j). We need to 
verify (j4]) which by (I14p now asserts that for some q > and r G (0, 1) we have 

l/r / _ \ 1/r 



C g , T := sup ^oo > d = sup || ^ ~~ ,. d < oo. 

den 2^=1 Mi deN fe=i Ei=i^(^>j) 

For strong polynomial tractability q = 0, whereas for polynomial tractability g > 0. 

1. Sufficiency of ffTBT) /or strong polynomial tractability. Note that 

(i oo d / oo \ d 

fc=l j=l fc=l \ j=2 J k=l \j=2 

(d oo \ / oo oo \ 

^]TA(M T <exp XX^M < oo (19) 

fc=l J=2 / \fc=l i=2 / 

due to (|T5|) . On the other hand, rife=i S^=i ^(^>i) — 1; hence Cq, t < oo. This implies 
strong polynomial tractability. 

2. Necessity of ffTol) /or strong polynomial tractability. We now know that Co )T < oo for 
some t G (0, 1). This implies that 

oo / oo \ oo / oo 

n i + ^\(kjy < n i + 

k=l \ j=2 J k=l \ j=2 

Since X(k,j) < 1 and r G (0, 1), we can estimate X(k,j) by X(k,j) T . This yields 

oo / oo \ 

n i+Ew <c :/ (i -^<oo. 

fc=l \ j=2 J 
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This is equivalent to 



oo oo oo oo 

fc=l j=2 fc=l j=2 



A(M) 



Hence (fT5|) holds, as claimed. The formula for the exponent of strong polynomial tractability 
follows from ([6]). 

3. Sufficiency of ( |T6l) /or polynomial tractability. By ( |T6l) we have 

d oo d / co 

HYs^tf = n i+ e^^') t 

k=l j=l k=l \ j=2 

= exp (j^ in ( i+ £^^' j ^ t )) - max ( eQT ' rfQr )- 

Using again the fact that n&=i Yl'jLi A(&,j) > 1, we conclude that C q>T < oo for q = Q T /r, 
and obtain polynomial tractability. Since condition ( 1T7|) is stronger than ffTBT) . it is also 
sufficient for polynomial tractability. 

4. Necessity of (|T6l) /or polynomial tractability. We now know that C gjT < oo for some 
g > and r G (0, 1). Proceeding as before we conclude that 

d / oo \ 

n i+e^jt u^^- 

k=l \ j=2 / 

Hence, 



J q,ri 



^ln I + ^A^jT <^ l n+d+T J—l nCq 

k=l \ j=2 / T T 

and ( 1T5|) follows. 

It is easy to see that under the assumption ( TT51) . the conditions (THjj) and ( 1T7|) are equiv- 
alent. Therefore, fJXTjl is also necessary in this case. □ 

We comment on the necessary condition for polynomial tractability. Typically, the coor- 
dinates in tensor product problems are ordered according to " decreasing importance" . This 
means that the sequence J^^l 2 A(A;, j) r is non-increasing in k. In this case (Jl~8]) holds and 
the simple condition ( IT71) is necessary and sufficient for polynomial tractability. However, 



16 



in general, nothing prevents us from a strange ordering of important and unimportant co- 
ordinates so that the sequence of ^2JL 2 X(k,j) T is not non-increasing in k. In this case the 
stronger condition (TPTj) may fail as illustrated by the following example. Let 



1 for j = 1, 

X(k,j) = X(k,j) = ^ 1 for j E [2, k] and k = 2 2 " 1 for non-negative integer m, 

otherwise. 

By counting the number of l's in X(k,j) we easily conclude that 



n 



avg 



[e, d) < H 2 2 '" < 2 2ln2(i " 2(d2)) = d 2 for all e E [0, 1) and d E N. 



m£N, 2 2 ™ 1 <d 

So polynomial tractability holds but condition ffTTj) fails. Therefore, in general, it is not 
necessary for polynomial tractability. 

4.2 Quasi-Polynomial Tractability 

We now consider quasi-polynomial tractability of tensor products. First of all let us check 
how the right-hand side of Lemma [3] simplifies in this case. Let 

oo oo d 

A(k):=J2Hk,j) and by (HI A d := J2 X d j = J[ A(k). 

3=1 j=l k=l 

For tensor products we have 

oo d d 

^2 \u In X dJ ^ j J X(k, z fc ) ^ ln K k > Z k) 

i=l z=[z 1 ,z 2 ,...,z d \eN d k=l k=l 

d 

= z2 -M A'. ~~k) hi A(A\ z k ) ] f A(m, z m ) 

fc=l z ^d l<m<d 

my^k 

d / oo 



^2 [Y,w,j)hL\(k,j)\ n 

k = l \j = l J l<m<d \j=l 

mj^k 



d / OO 



£ ^A(fc,j)lnA(fc,j) A ( 

fe=l \i=l / l<m<d 

d / oo \ » 



^^A^jOlnA^j)]^. (20) 
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Inequality ( TT2j) now becomes 

oo / d -. oo \ 

Ki 1 E A S 7 - exp ~ 7 E a?m E A ( fc ' i) ln A ( fc ' ■?') • ( 21 ) 

i=l V fc=l ^ > j=l J 

This inequality will be used in the following theorem which addresses quasi-polynomial 
tractability for tensor product problems. 

Theorem 7 Consider a tensor product problem S = {S^}. Then 

• S is quasi-polynomially tractable iff there exists 5 G (0, 1) such that 

Bu P n Er = iA(M) '71 <°°. (22) 

, =1 /V^OO A/7 \\ ln + d 



(s^iAfoj)) 



J/S 1 zs quasi-polynomially tractable then 



1 A(fc,j) / A(fc) ^ . 

3M^ ln te) <00 ' (23) 



If there exists 5 > snc/i t/iat 



d6N k=l \ 3 =2 



or 

d oo 



X(k,j)\ l »»« 



-EE(f§f"<~ w) 



fc=l j=2 

i/ien S quasi-polynomially tractable. 

Proof. In view of ( TT4l) . criterion ( |22l) is just the general criterion (j8]) in Theorem [2] 
specified for tensor products. The necessary condition in ( |23i) is just a specification of the 
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general necessary condition in (JT3J) for tensor products. To see this, note that 

Er ln r = In A, - A d 1 In A dj 

j=i d V ,3/ j =1 

(by (eod) = E lnA w-EE^y^ lnA (M 



X(k,j) , / A(fc) 



fe=l fc=i j= 

d 00 

A. A. a(/c) n VA(fc ?J ; 

To see that is sufficient for quasi-polynomial tractability, observe that the fraction 
in ( 122|) can be written with X(k,j) = X(k, j)/ X(k, 1) as 



ln_i_ d 



yj i+Er=2^,j) 1_ 

11 ~~L i — ~ 

fc=1 (i + Er= 2 A(^i)) in+d 

Taking logarithms, we see that the numerator is bounded by (pMI) while the denominator is 
larger than 1. Hence (|22|) is bounded and we are done. 

Since (J25l) is stronger than (1241) . it is also sufficient for quasi-polynomial tractability. □ 



4.3 Weak Tractability 

We present a simple criterion of weak tractability for tensor products. 
Theorem 8 Consider a tensor product problem S = {Sd}- If for some r G (0, 1] 

'A(fc,j)Y 



d 00 

iim d- 1 yy 

k=l j=2 



X(k,l] 







(26) 



then S is weakly tractable. 



Proof. The idea is basically the same as in the proof of Theorem El Namely, we apply ([7] 
with z — 1. As before, let X(k,j) := X(k, j)/ X(k, 1). Then ([7J), by (fT4l) can be rewritten as 



n w He 



d )<u 



k=l 



i + E°°= 2 A(M. 
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l/(l-r) 



-2/(l-r) 



Since the denominator above is larger than one, it may be dropped. Using fll9p we have 



n* vg {e,d) < 
where 



d oo 



1 V(l-T) 



expj^E^^) 6 

k=l j=2 



-2 



exp [(l-r)- 1 (6 d d + 2\n e' 1 )] , 



d oo 



e d ■= rf- 1 ^^A(A;,j) r -> as d — )■ oo 

fc=l j=2 

due to fl26|) . Equivalently, 

In n avg a(e,rf) < (1 - r)" 1 [# d d + 21n a' 1 ] . 



By (E . 

r ^rf + 21ne- 1 

hm : : = 0, 

d+e-^-^oo d + E 1 

and we obtain the weak tractability. 



Note that (EH holds if 



Hence (128]) implies weak tractability. The last condition yields 

: _ trace(Cf ) _ 1 



(27) 



□ 



(2i 



lim 

fe-s>oo X[k, 1) 

so that the Gaussian measure is asymptotically concentrated on the one-dimensional sub- 
space span(^(fc, 1)) of 11^. 



5 Multivariate Approximation and Korobov Kernels 

The non-homogeneous case offers the possibility of vanquishing the curse of dimensionality 
via variation of weights and smoothness parameters. We illustrate this by an example with 
Korobov kernels of decreasing weights gt and increasing smoothness tv As we shall see, 
even strong polynomial tractability holds if the decay of is sufficiently fast. Multivariate 
approximation for Korobov spaces in the worst case setting was recently studied in [14J. 
Here we present its average case analog. 
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In this section we consider a multivariate approximation problem defined over the space 
of continuous real functions equipped with a zero-mean Gaussian measure whose covariance 
is given as a Korobov kernel. More precisely, consider the approximation problem 

APP = {APP d } deN with APP d :C([0,l] d )^L 2 ([0,l] <i ) 

given by 

APP d / = / for all /GC([0,lf). 

The space C([0, l] d ) of continuous real functions is equipped with a zero-mean Gaussian 
measure /i d whose covariance kernel 

K d (x, y) = I f(x)f(y) » d (df), x, y e [0, l] d , 

JC({0,1]C) 

is given as follows. First of all we assume that K d is of product form, 

d 

K d (x,y) = Y[Tl k (x k ,y k ) for all x = [x u x 2 , . . .,x d ], y = [yi,y 2 , ■ ■ ■ ,Vd] e [0, 
k=i 

where TZ k = Ttr k ,g k are univariate Korobov kernels, 

oo 

Kr >f) (x,y) := 1 + 2/3 cos(2n j (x - y)) for all x,ye[0,l]. 

3=1 

Here f3 £ (0, 1] and r is a real number such that r > \. Note that for y = x we have 

K r>f) (x,x) = l + 2P{(2r), 

where ((x) = Y^jLi3~ x ls ^ ne Riemann zeta function which is well-defined only for x > 1. 
That is why we have to consider r > |. 

We assume that the sequence {r fe } is non- decreasing, 

\ < n < r 2 < • • • < r d < ■ ■ ■ . (29) 

The weight sequence {g k } serves as a scaling and, as we shall see, tractability results will 
depend on the behavior of g k at infinity. We assume that 

1 > 9i > 92 > ■ ■ ■ > 0. (30) 

As already mentioned, the sequences {r k } and {g k } may be related, g k = g(r k ) for some 
non-increasing function g : [|,oo) — > [0,1]. The case which can be often found in the 
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literature corresponds to = 1 or g^ = (27r)~ 2rfc . For g^ = g(rk) the behavior of g^ at 
infinity depends on the function g and the behavior of at infinity. A summary of the 
properties of the Korobov kernels can be found in Appendix A of [9]. 

For a fixed d, the multivariate approximation problem under similar conditions was stud- 
ied in [HI [13]. For varying d, the homogeneous case, i.e., TZf. = 71 for all k with 7Z not 
necessarily equal to a Korobov kernel, was studied in [51 El IS]- in this case, we have the curse 
of dimensionality since n av& (e, d) depends exponentially on d. 

The induced measure Vd = /ZdAPP d 1 on L 2 ([0, l] d ) is also a zero-mean Gaussian measure. 
It is known, see e.g., [9j, that the eigenvalues of its covariance operator C Vd are given by 

d 

X d,z = n A(fc, z k ) for all z = [z 1 ,z 2 ,...,z d )eN d , (31) 
fc=i 

where X(k, 1) = 1 and 

X(k,2j) = X(k,2j + l) 
Note that the trace of C Vd is 

d 

traced) = n( 1 + 2 ^^(2r fc )). 
fe=i 

We have the curse of dimensionality when 

g hm := lim g k > 0. 

Indeed, in this case 

trace(aj > (l + 2g hni ) d , 

and Lemma O yields the curse. Therefore lim^ g k — is a necessary condition to vanquish 
the curse. 

Theorem 9 Consider the approximation problem APP = {APP^} in the average case with 
a zero-mean Gaussian measure whose covariance operator is given as the Korobov kernel 
with the weights gu and smoothness r k satisfying fl30l) and (|2"9~j) . respectively. Then 

• APP is polynomially tractable iff 

In i 

p„ := liminf — > 1. (33) 
fc-i-oo In fc 



JEN. 



(32) 
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APP is strongly polynomially tractable iff it is polynomially tractable. If so, the expo- 
nent of strong polynomial tractability is 



p avg-str = 



2r x -V p g -l) ' 
//APP is quasi-polynomially tractable then 



sup j—z ln+ — < oo. (34) 



den ln+ d ^ gk 



If (J34J) holds and 



fc->oo In k 

then APP is quasi-polynomially tractable. 



liminf-^>0 (35) 



APP is weakly tractable iff 



lim g k = 0. 

k— >oo 



Proof: We will use Theorem Eland proceed in a way similar to that of the proof of Theorem 1 
in [13]. The main difference is that here r G (0, 1). 

We first show that ( )33|) implies strong polynomial tractability and then that polynomial 
tractability implies ( J33l) . Assume thus that (|33l) is satisfied. Then for some 5 > and all 
large k we have 

-Hr > 1 + 5 - 

in k 

Hence, there is a positive C such that for any r G (0, 1) we obtain 

£1 < C r £r r(1+5) for all keN. 
If we choose r G (y^> 1) H 1) then 

EE (WIT) = 2£ S ;£ r -><2^sup<(2rr l )J>-<«> 

fc=l j=2 v V ' // fc=i 3=1 fc fc=i 

< 2C T C(2rn)C(r(l + 5))<oo, 
and condition ( |T5l) of Theorem [6] yields strong polynomial tractability. 
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Assume now that polynomial tractability holds. Then for r £ (^-, 1) we have 

s 7 E Qjriy) = 2 T feT c(2rrfc)] = 2 ^ [ c(2rri) < °°' 

J— 2 

Therefore, condition f|T8|) is verified, hence condition f|T7|) is necessary for polynomial tractabil- 



ity. The latter condition for the Korobov case is 

2 d 

C:=sup ^2gl((2Tr k ) < oo, 



deN ln+ d i ^ 



for some r £ (^-,1). All terms of the last sum are larger or equal to g T d and therefore for 



d > 1 we have g T d < h . This is equivalent to 



M ^ > l( 1 _HC/2) + \n\nd 



\nd r V lnc? 
Hence, 

In -i- i 
p q = liminf — > - > 1, 

d^oo In a r 

as required in (133]) . 

We now turn to the exponent of strong polynomial tractability. We must have r > ^- 
and from the last displayed formula r > y. /.From Theorem [6] we obtain that 

p avg-str = 



2n -1 p g - 

This completes the proof of polynomial tractability. 

Assume now that quasi-polynomial tractability holds. Then the necessary condition 
is satisfied. Clearly, all terms appearing in this condition are positive. We simplify (I2"3"j) by 
omitting all terms for j ^ 2, and obtain 



d>N 



In 



Recall that for the Korobov case, A(k) = 1 + 2gk((2rk) and \(k,2) = g^. Since A(fc) > 1 
and A(/c)/A(/c, 2) > 3 we obtain 
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Furthermore, since {A(k)} is non-increasing, we have 



1 d ( 1 

d &\ ln+d ^ VMM) 



< oo. 



This is equivalent to (IMj) . and completes this part of the proof. 

We now prove that (|34p and (l35l) are sufficient for quasi-polynomial tractability. Theo- 
remUJstates that APP is quasi-polynomially tractable iff there exists 5 G (0, 1) such that (122]) 
holds, i.e., 

SU P II 7 w7 < °°> ( 37 ) 

*» ii(Er=i^,i)) 

where = 1 — j^-j- Take any <5 G (0, min(~, 1 — ^j-))- Inequality 5 < 1 — l/(2rx) ensures 
that all the sums above are finite because Ir^T^ > 2r\T\ > 1. 
We split the product in (157)1 into two products 



d / OO \ In i d 



HxCd) :=n E^: 

fc=l \i=l 
and 

2( ' ~\k TOM ■ 

In what follows we will write C for some positive number which is independent of d and k, 
and whose value may change for successive estimates. 

For Tli(d) we use (1 + x) 1 = exp(£ln(l + x)) < exp(tx) and have 

6 

d / OO \ ln + d / j- d OO 

fe=l V j=2 / V + fc=l j=2 



^ -Hi^E^C(2r fc )j<exp^^-X:^ 



Clearly, ( 1M]1 implies that sup deN IIi(c?) < oo. 

We now turn to the product n 2 (c?) - We estimate each of its factors by 

Er=iA(M " 1 + 2A(*,2) + ^ A( "' J) • (38) 
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Note that if | In A(2, k) | < 3 ln+ d, then 



1 + 2A(A;,2)^ _ 1 + 2A(A;, 2) exp ( 



-<5 lnA(fc,2) 
ln+ d 



l + 2X(k,2) l + 2A(fc,2) 

< l + 2A(A:,2)(l + ^M) gA (fc,2)|lnA(fc,2)| 
1 + 2A(M) ~ + ln+rf 

while if | In X(k, 2) | > 3 ln + d then 5 < \ implies 

1 1 +2A xn ,2 o ) r ^ 1 + 2X ^ 2 ) Td ^ 1 + 2A ( fc ' 2 ) 1/2 ^ 1 + 2cr3/2 ' 
1 + A(/c, 2) 



Thus, in any case 



l + 2A(fc,2) rd < 2rf -3/ 2 , CA(fc,2)|lnA(fc,2) 
l + 2A(fc,2) - ln+d 



(39) 



It remains to evaluate the sum in ( 1381) . An easy and elementary calculation shows that 
( 1341) implies X(k, 2) = g k < f . On the other hand, yields r k >h\nk-C for all fc G iV 
with appropriate h, C > 0. We obtain now 

oo 

5^A(A;,j) Td < CA(A;,4) Td = CA(A;,2) Td 4- rfcrd 

< C ■ (C/k) l - s/ln+d 2- ( ~ hlTlk - c ^ < Ck^ 1+U \ (40) 

where u = Mn2 > 0. Combining (13"5|) . (I3"9~j) ) and (HUj) . and using again 1 + x < exp(x) we 
easily check that 

Si^^'^^Jo^ , C7A(*,2)|hA(M)l 



Then it follows that 



n 2 (rf) < exp 



< / _ 3/2 + C^h^ + cr(1+ A 
\ ln + a / 



( T (V 3 / 2 + C*(M)|lnA(fc,2)l CJfe _ (1+u) 



< exp ( £ ( 2rf- 3 / 2 + C9 ^+° k + Ck-^ 



,fe=i 
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and implies that sup dgN n 2 (<i) < oo. Therefore, 



sup Hi(d) n 2 (<i) < supn^d) supn 2 (<i) < oo. 

den ciGN dGN 

Hence, (l37j) holds so that the quasi-polynomial tractability is proved. 

We now consider weak tractability. Sufficiency Let lim^ g% = 0. Then for an arbi- 
trarily small positive 5 there exists k(5) such that < 5 for all k > k(5). We check the 
assumption f l2T)j) of Theorem [HI For r G (l/(2r!), 1) and d > k(5) we have 

d 



fc=l j=2 \ V ' / / fc=l 

2C(2nr) 



d d 



Hence, 



limsup ad < S. 

d—>oo 

For 5 tending to zero, we conclude that limsup d = lim^ = 0, and obtain weak tractabil- 
ity due to Theorem 

Necessity. We have already showed that lim^ = is a necessary condition for weak 
tractability. This completes the proof. □ 



We do not know if (1351) is needed for quasi-polynomial tractability. However, for g^ = 
9{ r k) with g(r) = $ r and d G (0,1), or g(r) = r~ s and s > 0, this condition clearly 
follows from fl34l) since the latter implies that gf~ < For such weights and smoothness 
parameters, ( jMJ) is a necessary and sufficient condition for quasi-polynomial tractability. 

We illustrate Theorem for special weights. 

• Let gk = v Tk with v G (0, 1). 

— Strong polynomial tractability holds iff p r := liminffc^oo > ln . 
If so the exponent is p av §- str — m ax ^rf-i , - ^ 

— Quasi-polynomial tractability holds iff Ylt=i vVk max (l) r fc) = 0{\nd). 

— Weak tractability holds iff lirn^oo r^. = oo. 

• Let gk = r^ s for s > 0. 
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— Strong polynomial tractability holds iff p r := liminffc^oo > ~. 
If so the exponent is p av §- str — max ^rf-i ' p s-i ) " 

— Quasi-polynomial tractability holds iff Ylt=i r k S max(l,ln r^) = 0{hid). 

— Weak tractability holds iff lim^oo fk = oo. 

It is also important to notice that Theorem [9] holds for constant smoothness parameters 
Tk = r > \ if g>fc are no£ related to and satisfy the conditions presented in Theorem [9j 
This corresponds to appropriately decaying product weights, the case that was also studied 
in p. 276. 



6 Comparison of Korobov, Euler, and Wiener Kernels 

Another application of our general results is given in [7], where tensor products of multi- 
parametric Wiener and Euler integrated processes are considered. We briefly summarize the 
results of [7] to compare them to the results of the previous section. 

Let W(t),t G [0, 1], be a standard Wiener process, i.e. a Gaussian random process with 
zero mean and covariance Kf (s,t) = K™ (s,t) := min(s,t). Consider two sequences of 
integrated random processes X™, Xf on [0, 1] defined inductively on r by X™ = Xq = W, 
and for r = 0, 1, 2, . . . 

Jo 

X* +l {t) = f X*(s)ds. 
Ji-t 

{X™} is called the univariate integrated Wiener process, while {X®} is called the univariate 
integrated Euler process. 

Clearly, X™ and Xf have the same smoothness properties but they satisfy different 
boundary conditions. 

The covariance kernel of X™ is given by 

K ^y) = J o — — du 

and is called the Wiener kernel, while the covariance kernel of X® is given by 

Kf r (x, y) = min(a;, si) min(si, S2) ■ ■ ■ min(s r , y) &s\ ds2 ■ ■ • ds r 

J[o,i] r 
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and is called the Euler kernel. The last kernel can be expressed in terms of Euler polynomials, 
hence the name of the process and its kernel. 

The corresponding tensor product kernels on [0, l] d are given by 

d d 

Kj(s,t) = l[Kl rk (s k ,t k ), and K%(s,t) = IJlfJ^t*). 

k=l k=l 

As for the Korobov case, the sequence {r k } with integers 

n < r 2 < • • • < r d < ■ ■ ■ , 

describes the increasing smoothness of a process with respect to the successive coordinates. 

We now compare tractability results for processes described by the Euler, Korobov and 
Wiener kernels from [7J and from Theorem [9j Some results are the same: 

• strong polynomial tractability and polynomial tractability are equivalent, 

• there is a lim-inf-type criterion for polynomial tractability, 

• there is a narrow zone where quasi-polynomial tractability holds while polynomial 
tractability fails, 

• weak tractability is equivalent to a convergence without rate, lim^r^. = oo for both 
integrated processes, or to lim*, g k = for Korobov case, 

• if weak tractability fails then the curse of dimensionality appears. 

The conditions on strong polynomial tractability for Euler and Wiener integrated pro- 
cesses are different. Namely, strong polynomial tractability holds iff 

Pe := liminf - — - > — for Euler integrated process, 

d^oo In a 2 In 3 

p w := liminf — > for some s > \ for Wiener integrated process. 

For the Korobov case, strong polynomial tractability depends on {g d } and holds iff 

p K := liminf 9d > 1, 
rf->oo In a 

For gd = 9~ rd , we see that px = (2 In 3) pe and conditions for strong polynomial 
tractability for the Euler and Korobov cases are equivalent. 
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For g d = d r <i/ d \ we see that pw = p K . Hence, strong polynomial tractability holds for 
the Wiener and Korobov cases if pw > 1, whereas it holds only for the Wiener case when 
Pw e (0,1]. 

Without going to technical details, we may say that all depends on the two largest 
eigenvalues for the univariate cases. These eigenvalues are quite different for the Euler and 
Wiener cases, whereas for the Korobov case they depend on the weights g k . By adjusting 
these weights, the Korobov case behaves either like the Euler or Wiener case. 
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